Estimation and variable selection with exponential weights
نویسندگان
چکیده
منابع مشابه
PAC-Bayesian Bounds for Sparse Regression Estimation with Exponential Weights
We consider the sparse regression model where the number of parameters p is larger than the sample size n. The difficulty when considering high-dimensional problems is to propose estimators achieving a good compromise between statistical and computational performances. The BIC estimator for instance performs well from the statistical point of view [11] but can only be computed for values of p o...
متن کاملStructured Variable Selection and Estimation
In linear regression problems with related predictors, it is desirable to do variable selection and estimation by maintaining the hierarchical or structural relationships among predictors. In this paper, we propose nonnegative garrote methods that can naturally incorporate such relationships defined through effect heredity principles or marginality principles. We show that the methods are very ...
متن کاملLearning Permutations with Exponential Weights
We give an algorithm for learning a permutation on-line. The algorithm maintains its uncertainty about the target permutation as a doubly stochastic matrix. This matrix is updated by multiplying the current matrix entries by exponential factors. These factors destroy the doubly stochastic property of the matrix and an iterative procedure is needed to re-normalize the rows and columns. Even thou...
متن کاملAsymptotics associated with Exponential Weights
We announce some asymptotics for orthogonal and extremal polynomials associated with exponential weights W = exp ( Q). 1 Classes of Weights Let I be a nite or in nite interval and let Q : I ! [0;1) be convex. Let W := exp ( Q) and assume that all power moments Z I xW (x)dx; n = 0; 1; 2; 3; ::: are nite. Then we may de ne orthonormal polynomials pn(x) = pn(W ; x) = n(W )x + : : : ; n(W ) > 0;
متن کاملAdditive Schwarz with Variable Weights
For Additive Schwarz preconditioning of nonsymmetric systems, it is proposed to use weights that change from one iteration to the next. At each iteration, weights for all earlier iterations are implicitly chosen to minimize the current residual. This strategy fits the paradigm of the recently proposed multipreconditioned GMRES. Numerical experiments illustrating the potential of the proposed me...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2014
ISSN: 1935-7524
DOI: 10.1214/14-ejs883